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WHY  THE  "T"  IN  SMART 

A  CONSTRUCTIVE  SYNERGY 


irC  Mhhael  D,  Proitor,  USA  (Ret),  Amy  Posey-Maialintal, 
and  Dennis  Kulonda 

Department  of  Defense  (DoD)  simulation-based  acquisition  (SBA)  is  widely 
discussed  in  literature.  The  Army  offers  a  broad  vision  of  SBA  concept  in  the 
form  of  Simulation  and  Modeling  for  Acquisition,  Requirements,  and  Training 
(SMART),  accenting  not  only  the  Acquisition  process  but  also  essential 
contributions  from  the  Requirements  and  Training  communities.  This  research 
highlights  how  organizational  training  simulation  has  significantly  helped  the 
acquisition  process  beyond  the  confines  of  post-acquisition  training. 


Training  is  essential  to  the  successful 
fielding  of  any  new  weapon  system. 
As  a  part  of  the  system  life  cycle, 
the  value  of  training  is  well  established. 
Further,  the  training  community  is  well 
known  for  their  ability  to  contribute  to  the 
development  of  training  packages  for  new 
materiel  acquisitions.  This  research  reveals 
that  with  increased  realism,  training  simu¬ 
lations  may  now  provide  a  significant  and 
credible  resource  useful  to  acquisition 
managers,  which  goes  beyond  training 
packages. 

The  research  investigates  the  hypotheses 
that  an  organizational  training  simulation 
may  support  materiel  acquisition  and, 
hkewise,  materiel  acquisition  may  support 
organizational  training  simulation  devel¬ 
opment.  Using  a  case  study  methodol¬ 
ogy,  the  research  reveals  how  the  Close 


Combat  Tactical  Trainer  (CCTT)  training 
simulation  played  a  critical  part  in  the 
Battlefield  Combat  Identification  System 
(BCIS)  acquisition  as  well  as  how  the 
BCIS  advanced  the  CCTT. 

This  paper  presents  archival  record, 
experimentation,  cost,  interview,  and  sur¬ 
vey  highlights  from  the  case  study  as  well 
as  discusses  the  Simulation  and  Model¬ 
ing  for  Acquisition,  Requirements,  and 
Training  (SMART)  approach  to  acquisi¬ 
tion.  The  SMART  approach,  in  part, 
advocates  an  explicit  strategy  to  integrate 
training  simulation  in  acquisition  where 
appropriate.  Additionally,  this  paper  also 
identifies  tenets  that  may  promote  a 
synergistic  and  mutually  beneficial 
relationship  between  training  simulation 
and  materiel  acquisition.  Finally,  the  case 
study  identifies  process  mechanisms  that 


285 


Aiquisition  Review  Quarterly  —  Summer  2003 


may  help  insure  up-to-date-training 
systems  are  available  when  new  equipment 
systems  are  fielded  or  possibly  tested. 

Employing  Training  Simulation  in 
THE  Acquisition  Process 


Simulation-based  acquisition  as  pur¬ 
sued  by  Department  of  Defense  (DoD)  is 
widely  discussed  in  literature  and  confer¬ 
ence  activities.  The  use  of  simulation  in 
the  system  life  cycle  continues  to  grow. 
Managers  report  gains  in  terms  of  quality, 
productivity,  and  performance  as  well  as 
reductions  in  cost,  cycle  time,  lag  time, 
and  risk.  This  success  has  not  come  about 
by  chance,  but  rather  by  planned  and 


deliberate  actions  by  astute  acquisition 
managers.  A  few  examples  are  referenced 
below  (Zittel,  2001;  Brantley,  McFadden, 
&  Davis,  2002;  Garber,  2001;  Johnson, 
McKeon,  &  Szanto,  1998;  Sanders,  1997). 

The  Army  and  its  simulation  action 
agent,  the  Army  Modeling  and  Simulation 
Office,  promote  a  version  of  simulation- 
based  acquisition  called  SMART  (Ellis, 
Kern,  &  Hollis,  2002;  Lunceford, 
2002).  SMART  is  more  than  semantics. 
SMART  emphasizes  not  only  the  essen¬ 
tial  acquisition  process,  but  also  the 
quality  enhancing  contributions  of  the 
training  and  requirements  communities 
to  that  process. 

For  the  Army,  a  key  vehicle  for  suc¬ 
cess  has  been  the  Simulation  Support 
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Figure  1.  Selected  Program  Events  and  Levels  of  Modeling 
and  Simulation  from  Functional  Areas 
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Plan,  (Ellis,  et  al.,  2002).  A  Simulation 
Support  Plan  provides  a  means  of  de¬ 
veloping  a  roadmap  of  simulation  inte¬ 
gration  within  the  life  cycle  of  a  system 
acquisition. 


The  Simulation  Support  Plan  is 
the  plan  identifying  utilization  of 
models  and  simulations  over  the 
lifecycle  of  an  acquisition  pro¬ 
gram  from  concept  and  technol¬ 
ogy  development  to  system 
disposal.  It  is  a  document  that 
evolves  as  the  system  matures. 
Because  SMART  is  an  enabler 
to  the-meeting  Army  Transfor¬ 
mation  objectives,  the  Simula¬ 
tion  Support  Plan  will  discuss 
how  SMART  is  implemented  in 
the  program.  (Ellis,  et  al.,  2002, 
p.  69) 


One  notional  representation  of  the 
source  and  level  of  simulation  contribu¬ 
tion  across  the  system  life  cycle  is  shown 
in  Eigure  1.  Some  key  events  in  the  life 
cycle  are  also  noted  for  reference  pur¬ 
poses.  In  the  SMART  concept,  the  Inte¬ 
grated  Concept  Team  and  the  Integrated 
Product  Team,  under  the  leadership  of 
acquisition  managers,  interweaves  the  use 
of  models  and  simulations  into  the  system 
life  cycle.  The  team  plans  and  schedules 
activities  that  lead  to  successful  materiel 
acquisition. 


The  Hypotheses  of  Mutuai  Behefit 


Not  clear  in  the  literature  is  the  contri¬ 
bution  that  organizational  training  simula¬ 
tions  may  make  to  the  acquisition  process 
or  the  contribution  the  acquisition  process 


may  make  to  organizational  training  simu¬ 
lations.  By  the  term  organizational  train¬ 
ing  simulation,  we  are  referring  to  a  com¬ 
position  of  various  simulation  systems  that 
attempt  to  represent  a  military  organiza¬ 
tion  for  organizational  training  purposes. 
Eor  the  Army,  the  CCTT  is  one  example. 
The  Distributed  Mission  Trainer  is  an 
example  for  the  Air  Eorce. 

What  is  significant  is  that  organiza¬ 
tional  training  simulations  go  beyond 
stand-alone  simulators  to  encompass  a 
composite  of  the  various  systems  found 
in  the  organization.  Simulation  of  an  or¬ 
ganization  potentially  enables  savings 
based  on  scale  rather  than  simply  sav¬ 
ings  gained  through  direct  one-to-one, 
simulator-to-system  simulation. 

Our  hypothesis  is  that  not  only  can  these 
organizational  training  simulations  help, 
primarily  through  the  advantages  of  scale, 
a  weapon  system  development  during  its 
life  cycle,  but  also  outflow  from  the 
weapon  system  development  may  advance 
model  fidelity  within  the  organizational 
training  simulation. 


Syhergy  betweeh  the  Two 


Prom  a  theoretical  perspective,  simu¬ 
lation  success  hinges  on  software  devel¬ 
opment  factors  identified  by  McCabe 
(1980)  and  listed  below. 

Fidelity:  the  accuracy  of  the  represen¬ 
tation  when  compared  to  the  real  world 
for  the  applications  that  it  was  intended. 

Modularity:  allowing  a  program  to  be 
created  from  individual  modules. 

Expandability:  allowing  the  expan¬ 
sion  of  requirements  for  storing  data 
and  scalability  in  computing. 
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Self-Descriptiveness:  clarity  in  terms 
of  explaining  how  a  system  works  through 
easy  to  use  Graphical  User  Interfaces 
(GUIs)  and  tools,  visibility  of  behaviors 
and  models,  documentation,  and  self¬ 
descriptiveness  of  code. 

Self-Explanatory:  ability  to  under¬ 
stand  model  output. 

Software  System  Independence: 
shows  how  much  a  program  depends  on 
its  computational  system  as  well  as 
reduces  the  burden  on  human  support 
personnel. 

Interoperability:  allowing  the  use  of 
standard  communications  protocols  so  that 
it  can  work  with  other  simulations. 

Data  Commonality:  allowing  the  rep¬ 
resentation  of  data  in  a  standard  form  that 
is  applicable  across  all  domains  and 
promotes  reuse. 

Our  formal  research  survey,  of  selected 
and  government)  simula¬ 
tion  professionals  iden¬ 
tified  by  the  Director  of 
the  Army  Modeling  and 
Simulation  Office,  re¬ 
vealed  that  of  the  above 
factors  Self-Descriptive- 
ness.  Interoperability, 
and  Data  Commonality 
were  statistically  ranked 
higher  in  importance  in 
terms  of  creating  ca¬ 
pable  and  reusable  mod¬ 
els  and  simulations  (Wilcoxon  Signed 
Rank  Test,  p  =  .1). 

That  is  to  say,  leading  simulation  pro¬ 
fessionals  view  interoperability  and  data 
commonality  along  with  self-descrip¬ 
tiveness  as  the  most  significant  factors 
in  terms  of  simulation  capability  and  re¬ 
usability.  Further,  funding  priorities 
within  the  simulation  community  reflect 


(from  industry 


^^From  the 
acquisition 
perspective, 
interoperabiiity 
and  data  com- 
monaiity  may 
prove  very 
heipfui/^ 


that  importance.  For  example,  over  the 
past  decade,  the  Defense  Modeling  and 
Simulation  Office  funded  and  created: 
(1)  the  High  Level  Architecture  for  simu¬ 
lation  interoperability  and  (2)  Synthetic 
Environment  Data  Representation  and 
Interchange  Specification  toward  data 
commonality. 

From  the  acquisition  perspective, 
interoperability  and  data  commonality 
may  prove  very  helpful.  For  example,  a 
Program  Manager  of  a  new  system  devel¬ 
opment  may  leverage  interoperability  and 
data  commonality  investments  by  taking 
advantage  of  the  scale  implications.  Spe¬ 
cifically,  interoperability  and  data  com¬ 
monality  enable  composition  of  simula¬ 
tion  systems  involving  scores,  if  not 
hundreds,  of  synthetic  entities. 

While  emphasizing  interoperability 
and  data  commonality,  the  simulation 
community,  based  on  our  survey,  may  not 
emphasize  model  fidelity  as  strongly  as 
they  do  other  simulation  attributes.  This 
may  result  in  the  acquisition  community 
having  models  of  new  systems  that  are  of 
insufficient  fidelity  to  realize  the  benefits 
and  savings  of  the  SMART  approach  to 
system  acquisition.  From  an  acquisition 
perspective  that  infers,  with  the  advent  of 
a  new  materiel  system,  the  burden  of 
model  development  for  the  new  materiel 
rests  with  the  acquisition  manager. 

Compounding  the  possible  fidelity 
shortfall  of  models  for  new  materiel  in  an 
organizational  training  simulation  is  the 
need  for  increasing  fidelity  of  the  new 
model.  This  is  brought  out  in  part  by  the 
data  evolution  phenomenon  identified  by 
Ellis,  et  al.  (2002)  and  shown  in  Eigure  2. 
As  systems  develop  over  time,  data  re¬ 
quirements  experience  increasing  need 
for  higher  fidelity  and  greater  breath 
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Program  Management  - 
Requirements  - 
Cost 
Maint( 


Ellis  dt  al,  2002 


Figure  2.  Growing  Requirement  for  Fideiity  and  Breath 
in  the  Distributed  Product  Description 


while  expanding  to  more  activities  dis¬ 
tributed  within  an  organization  and 
across  organizations.  Therefore,  exist¬ 
ing  models  of  new  materiel  acquisitions 
sufficient  for  stand-alone  analysis  may 
need  further  refinement  to  be  suitable 
in  an  organizational  context. 

The  U.S.  Army  Program  Executive 
Office  for  Simulation,  Training,  and 
Instrumentation  maintains  that  synthetic 
environment  enhancements  can  occur 
concurrent  with  weapon  system  develop¬ 
ment.  This  may  happen  as  model  fidelity 
enhancements  are  funded  so  as  to  enable 
representation  of  a  new  weapon  system 
phenomenon.  Hence  the  state  of  simula¬ 
tion  may  advance  along  with  weapon 
system  development  as  implied  by  the 
Snake  Chart  in  Figure  3.  The  key  elements 
of  this  chart  are  the  two  development  lines 
(simulation  environment  and  weapon 
system)  interwoven  by  a  line  that  snakes 
from  one  development  effort  to  the  other. 
The  winding  of  the  Snake  represents  the 


flow  of  insights,  deliberately  common 
databases,  algorithms,  software  routines, 
architectures,  processes,  etc  from  one 
development  effort  to  the  other  over  time. 
The  flow  emphasizes  the  feedback  into 
simulation  development  that  can  be 
accrued  during  the  materiel  acquisition 
(weapon  system)  development  and  vice 
versa.  For  example,  modeling  of  a  weapon 
system  in  a  simulation  may  yield  insights 
that  advance  the  state  of  the  weapons  sys¬ 
tem  development.  Likewise,  weapon  sys¬ 
tem  development  may  create  new  reus¬ 
able  weapon  system  models  and  simula¬ 
tions  for  future  simulation  system  devel¬ 
opment,  thereby  promoting  synergy  be¬ 
tween  weapon  system  development  and 
synthetic  environment  development. 

Program  Descriptions 


To  examine  the  hypothesis  of  mutual 
benefit,  a  case  study  needed  to  have  an 
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Simulation  and  Modeling  for  Acquisition, 
Requirements,  and  Training  (SMART) 


[  Pre-MS  a] 
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(Program  Executive  Office  Simulation,  Training  and  Instrumentation, 
provided  by  J.  Tomasello,  personal  communication.  May  1 , 2002) 


Figure  3.  ^^Snake  Chart^^ 


organizational  training  simulation  and 
a  materiel  acquisition  system  interact  as 
described  above  (Yin,  1994).  For  this 
research,  the  materiel  system  called  the 
BCIS  managed  by  Product  Manager, 
Combat  Identification  was  identified  as 
the  acquisition  program.  The  CCTT  simu¬ 
lation  was  identified  as  the  organizational 
training  simulation  system.  These  two 
systems  interacted  with  each  other  during 
the  BCIS  acquisition. 

The  CCTT  is  the  first  virtual  simula¬ 
tion  training  system  developed  under  the 
Combined  Arms  Tactical  Trainer  (CATT) 
program  (Figure  4).  The  CATT  is  acquir¬ 
ing  a  group  of  high-fidelity,  interactive, 
manned  simulators  for  training.  The  CATT 


program  provides  command,  control, 
and  communications  workstations,  and 
exercise  control  stations.  After  Action 
Review  systems  and  the  Virtual  Com¬ 
bined  Arms  synthetic  environment  to 
support  virtual  training  organizations  up 
to  battalion/task  force  level. 

Using  interoperability  and  data  com¬ 
monality,  the  CCTT  system  trains  tank  and 
mechanized  infantry  organizations  from 
platoon  to  battalion  task  force,  including 
cavalry  scout  platoons  and  heavy  cavalry 
troops  on  collective  tasks.  The  CCTT  sys¬ 
tem  offers  commanders  the  opportunity  to 
develop  and  tailor  structured  exercises 
based  on  mission,  enemy,  troops,  terrain, 
and  time  available  to  meet  the  training 
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,  Courtesy  of  Lockheed  Martin  Corporation 

Figure  4. 

Training  in  the  Ciose  Combat  Tacticai  Trainer  Virtuai  Environment 


plan  and  objectives  of  the  organization 
(Figure  5).  CATT  virtual  synthetic  environ¬ 
ment  includes  large-scale  virtual  terrain  rep¬ 
resentation  with  natural  synthetic 
environment  effects  (e.g.,  weather  effects), 
accredited  computer  generated  forces 
replicating  adjacent,  supporting,  and 
opposing  forces  (Barlow,  2003). 

Part  of  the  Combat  Identification  pro¬ 
gram,  theBCIS,  is  a  millimeter  wave  device 
that  is  integrated  into  the  vehicle  subsystems 
to  aid  in  target  identification.  The  intent  of 
the  device  is  to  reduce  fratricide  (friend  on 
friend  combat  engagement).  The  BCIS  at¬ 
tempts  to  reduce  fratricide  by  identifying  at 
the  gunner’s  sights  contacts  as  friendly  if 
the  contact  is  equipped  with  the  BCIS  or 
UNKNOWN  if  otherwise.  The  BCIS  works 
effectively  through  smoke,  dust,  sand,  rain, 
fog,  and  beyond  visual  range.  A  typical 


BCIS  event  occurs  with  Abrams  or  Bradley 
platforms  interacting  with  other  friendly  and 
opposing  combat  vehicles  as  well  as  non- 
combatant  vehicles  (Maddux,  Kwiecien,  & 
DeChiaro,  2001;  J.  Tomasello,  personal 
communication.  May  1,  2002). 

Mutual  Benefit 


Operational  testing  of  the  BCIS  was 
needed  in  order  to  assist  the  U.S.  Army  in 
making  an  acquisition  decision.  A  tradi¬ 
tional  approach  to  such  testing  would  be 
to  conduct  a  live  exercise  in  the  field  using 
real  vehicles  equipped  with  BCIS. 
Because  of  the  investments  of  the  simu¬ 
lation  community  in  interoperability  and 
data  commonality,  an  alternative  to  live 
field-testing  existed  in  the  Close  Combat 
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Courtesy  of  Evans  &  Sutherland 

Figure  5.  Screen  Shot  from  Close  Combat  Tactical  Trainer  Simulator 


Tactical  Training  system.  Using  an  or¬ 
ganizational  training  simulation  to  re¬ 
place  an  operational  test  is  innovative 
as  well  as  not  typically  considered  at 
this  stage  of  the  system  life  cycle.  Yet, 
due  to  a  creative  approach,  this  alterna¬ 
tive  was  allowed  to  develop. 

J.  Tomasello  (personal  communication. 
May  1,  2002),  winner  of  a  SMART  2002 
award  for  his  efforts  (Lunceford,  2002), 
clarifies  the  two  choices: 

The  goal  was  to  determine  if 
Battlefield  Combat  Identification 
System  made  a  greater  contribu¬ 
tion  than  other  situational  aware¬ 
ness  equipment  choices.  For  the 
operational  component  of  the 


assessment,  [Program  Manager] 
PM  Combat  Identification  had  the 
choice  of:  (I)  going  to  the  Nation¬ 
al  Training  Center  and  standup  a 
battalion  force  of  combat  vehicles 
with  the  equipment  to  be  tested 
or  (2)  utilizing  the  Close  Combat 
Tactical  Trainer  facility  at  Ft. 
Hood,  Texas  for  the  operational 
evaluation.  (J.  Tomasello,  per¬ 
sonal  communication.  May  1, 
2002) 


The  estimated  cost  of  pursuing  a  live 
field-operational  test  was  approximately 
$20  million  (J.  Maddux,  personal  commu¬ 
nication,  n.d.,  2003).  For  case  study  re¬ 
search,  Yin  (1994)  indicates  that  archival 
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records  are  a  source  of  evidence  to 
explain  or  provide  context  for  such  case 
evidence.  As  such,  General  Accounting 
Office  (GAO)  reports  can  provide  some 
insight  as  to  the  validity  of  this  $20  mil¬ 
lion  dollar  estimate.  While  recent  GAO 
estimates  do  not  delineate  actual  exer¬ 
cise  costs  at  the  National  Training  Cen¬ 
ter,  they  do  indicate  that  the  Army 
spends  more  than  a  $1  billion  annually 
to  provide  training  for  123  battalion  at 
its  three  Combat  Training  Centers 
(Schuster,  1999).  This  includes  far  less 
expensive,  non-mechanized  battalion 
rotations  at  the  Joint  Readiness  Train¬ 
ing  Center.  Nonetheless,  that  is  still  ap¬ 
proximately  $8.1  million  per  battalion 
in  FY  1998  dollars  or  $8.8  million  in 
FY  2001  dollars. 

The  last  reported  GAO  cost  estimates 
for  unit  costs  for  mechanized  battalion 
training  at  the  National  Training  Center 
is  $4  to  $6  million  per  unit  for  1983  to 
1985  ($7.1  to  $10.6  million  2001  dollars 
using  the  Bureau  of  Labor  Statistics 
Inflation  calculator  http://www.bls.gov/ 
cpi)  (Conahan,  1986).  These  figures  do  not 
include  National  Training  Center  operat¬ 
ing  and  instrumentation  costs,  which 
would  be  prorated  across  the  number  of 
units  training  on  an  annual  basis.  The 
GAO  reports  that  those  costs  ranged  from 
$62  to  $90  million  annually  for  the  1983 
to  1985  period  (Conahan,  1986).  Addition¬ 
ally,  the  GAO  estimates  do  not  include  low 
rate  production  costs,  equipment  up¬ 
grades,  and  other  associated  costs  neces¬ 
sary  to  actually  implement  a  field  test 
using  BCIS  equipment.  In  this  context,  a 
$20  million  estimate  for  BCIS  testing  does 
not  appear  to  be  unreasonable. 

On  the  other  hand,  the  total  cost  for  con¬ 
ducting  BCIS  testing  in  CCTT  actually 


came  to  approximately  $2  million.  That 
cost  included  related  modeling  efforts, 
incorporation  of  models  within  CCTT 
environment,  expanding  the  data  collec¬ 
tion  and  reduction  capabilities,  and  per¬ 
forming  data  analyses  (J.  Maddux,  per¬ 
sonal  communication,  n.d.,  2003).  The 
same  level  of  testing  was  achieved  with¬ 
out  imposing  on  the  National  Training 
Center.  Further,  the  potential  for  conduct¬ 
ing  additional  scenarios  and  events  not 
possible  in  a  live  setting  due  to  safety  and 
environmental  restrictions  was  possible. 
J.  Tomasello  (personal  communication. 
May  1,  2002)  explains  the  advantages. 


Even  though  configuring  the 
Close  Combat  Tactical  Trainer 
and  designing  the  evaluation  to 
replicate  the  different  options 
took  a  year  and  involved  the  co¬ 
operation  of  the  Army  Test  and 
Evaluation  Command  and  the 
Army  Materiel  Analysis  Activity 
(this  would  have  had  to  been  done 
anyway),  the  saving  from  not  hav¬ 
ing  to  modify  equipment,  operate 
it  in  the  field,  or  endanger  person¬ 
nel  during  real  operations  all  were 
savings  that  could  be  identified  in 
real  time.  Further,  the  collabora¬ 
tion  between  Developer,  Tester, 
and  Trainer  yielded  additional 
benefits  in  quality  improvements 
to  Battlefield  Combat  Identifica¬ 
tion  System  that  may  not  be  as 
easily  quantified.  The  results  were 
part  of  the  test.  The  data  were 
actually  used.  General  Kern  could 
say  Battlefield  Combat  Identifi¬ 
cation  System  does  reduce  the  in¬ 
cident  of  fratricide.  That  was  all 
done  in  the  simulation  as  part  of 
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the  operational  evaluation.  We 
could  readily  do  night,  fog,  and 
rain,  etc.  on  demand  that  Na¬ 
tional  Training  Center  could  not. 
(J.  Tomasello,  personal  commu¬ 
nication,  May  1,  2002) 


With  estimates  of  a  90  percent  cost  sav¬ 
ings,  lead-times  within  the  planning  cycle, 
and  with  increased  flexibility  and  capa¬ 
bility,  J.  Maddux  (per¬ 
sonal  communication, 
n.d.,  2003),  Product 
Manager  for  Combat 
Identification,  funded 
the  modeling  efforts  to 
represent  the  BCIS  in 
the  CCTT.  One  essen¬ 
tial  aspect  for  this  fund¬ 
ing  required  that  the 
BCIS  simulator  code, 
called  the  Battlefield  Identification  Sys¬ 
tem  Environment  and  Performance 
Simulator,  be  put  in  the  CCTT  code.  J. 
Tomasello  (personal  communication. 
May  1,  2002)  indicates  how  that  was 
done: 


^^One  of  the 
key  lessons 
learned  from 
this  case  study 
is  the  SMART 
approach  taken 
by  the  key 
leaders/^ 


Georgia  Tech  Research  Institute 
developed  the  Battlefield  Identi¬ 
fication  System  Environment  and 
Performance  Simulator,  initially 
a  server  based  application  that 
replicated  what  happened  when 
you  probe  somebody  with  the 
Battlefield  Combat  Identification 
System  millimeter  wave  system. 
We  took  the  Battlefield  Identifi¬ 
cation  System  Environment  and 
Performance  Simulator  off  the 
server  and  embedded  Battlefield 
Identification  System  Environ¬ 
ment  and  Performance  Simulator 


into  Close  Combat  Tactical 
Trainer  code.  We  designed  the 
software  so  it  was  distributed  to 
the  manned  modules  and  re¬ 
moved  the  server  as  a  single 
point  of  failure.  (J.  Tomasello, 
personal  communication  May 
1,  2002) 


This  enabled  the  CCTT  to  support  test¬ 
ing  of  the  Battlefield  Combat  Identifica¬ 
tion  System.  Trials  were  conducted  and 
the  Army  Test  and  Evaluation  Command 
and  the  Army  Materiel  Analysis  Activity 
utilized  the  accredited,  simulated  battle 
trials  generated  in  theCCTT  in  their  test 
and  evaluations  plans,  replacing  the  live 
simulation  trials  that  were  avoided. 


A  Smart  Approach  to  Acquisition 


One  of  the  key  lessons  learned  from  this 
case  study  is  the  SMART  approach  taken 
by  the  key  leaders.  Elements  of  that 
approach  include  innovation,  leadership, 
collaboration,  and  an  active  involvement 
of  the  Integrated  Product  Team  with  the 
goal  of  wisely  using  all  possible  simula¬ 
tion  alternatives.  PM  innovation  and  cre¬ 
ativity  was  paramount  to  taking  on  the  risk 
of  providing  resources  to  pursue  the 
unproven  route  of  using  organizational 
training  simulations  to  replace  operational 
field  testing.  In  essence,  PM  Combat  Iden¬ 
tification  took  advantage  of  the  opportu¬ 
nity  by  being  open  to  this  non-traditional 
approach. 

Leadership  was  essential  by  both  the 
PM  Combat  Identification  and  PM  CATT 
in  order  to  capitalize  on  the  opportunity. 
Collaboration  was  the  means  by  which 
things  were  accomplished.  PM  Combat 
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Identification  and  PM  CATT  cultivated 
collaboration  across  their  organizations 
and  participants  from  the  Army  Test  and 
Evaluation  Command,  the  Army  Mate¬ 
riel  Analysis  Activity,  III  Corps, 
Lockheed  Martin,  Science  Applications 
International  Corporation  (SAIC),  DSCI, 
Pulau  Electronics,  and  Georgia  Tech 
Research  Institute  through  their  leader¬ 
ship  of  the  Integrated  Product  Team.  In 
the  words  of  Mr.  J.  Tomasello  (personal 
communication.  May  1,  2002): 


The  SMART  process  changes  are 
major.  What  SMART  does  is 
break  barriers  down  giving  every¬ 
one  a  common  goal.  Collabora¬ 
tion  is  of  the  utmost  importance. 
Eor  a  process  team,  you  have  got 
to  agree  from  the  start,  what  your 
objectives  are,  what  your  require¬ 
ments  are.  (J.  Tomasello,  personal 
communication.  May  1,  2002) 


Expanding  on  these  insights,  coopera¬ 
tion  between  the  acquisition  community 
and  the  training  system  development  com¬ 
munity  also  makes  for  faster,  more  effi¬ 
cient  and  effective  transition  of  high- 
fidelity,  software  updates  for  materiel 
systems.  J.  Tomasello  (personal  com¬ 
munication,  May  1,  2002)  explains  one 
process  mechanism  that  has  reduced 
training  simulation  software  lead-times. 


Scratching  the  surface  of  reuse 
and  SMART  is  our  basic  program 
for  our  M2A3  Bradley  Eighting 
Vehicle  and  M1A2SEP  Abrams 
Tank.  We  take  the  vehicle  soft¬ 
ware  and  have  it  modified  with  a 
wrapper  around  it  so  that  it  runs 
in  Close  Combat  Tactical  Trainer. 


When  General  Dynamics  (sys¬ 
tem  manufacturer)  puts  out  an 
update,  we  have  a  third  party  — 
OASIS  —  ...  deliver  the  code 
with  the  wrapper  to  CCTT  as  well 
as  Advanced  Gunnery  Training 
System,  the  Maintenance  Trainer 
and  the  Driver  Trainer.  It  is  a  li¬ 
brary  they  dehver  that  we  take  and 
drop  into  our  systems.  Close 
Combat  Tactical  Trainer,  manned 
modules,  everything.  The  big  ad¬ 
vantage  of  this  process  is  that  the 
tank  commander,  gunner,  loader, 
etc.  sees  the  latest  version  of  the 
software  in  Close  Combat  Tacti¬ 
cal  Trainer.  You  don’t  want  one 
version  of  the  interface  software 
being  fielded  with  the  weapons 
systems  and  another  version  of 
the  software  in  the  Close  Com¬ 
bat  Tactical  Trainer.  (J.  Tomasello, 
personal  communication.  May  1, 
2002) 


This  cooperation  between  the  materiel 
developer  and  the  organizational  training 
system  developer  enables  training  systems 
to  be  up-to-date  when  new  materiel  sys¬ 
tem  updates  reach  the  field.  This  process 
mechanism  may  also  make  it  possible  to 
conduct  future  operational  testing  in 
organizational  training  simulations  in  an 
even  more  rapid  fashion  then  occurred  in 
this  case  study. 

Eor  this  case  study,  leadership  found 
traction  through  creativity,  collaboration, 
capitalization,  and  cultivation  —  all  of 
which  may  be  considered  key  tenets  of 
SMART.  Euture  acquisition  managers 
may  consider  promoting  cross-domain 
collaboration,  cultivation  of  a  life  cycle 
perspective  among  team  members,  and 
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capitalization  of  Modeling  and  Simula¬ 
tion  (M&S)  assets  in  order  to  achieve 
program  benefit. 


Conclusion 


With  increased  realism  and  the  ben¬ 
efits  of  scale  made  possible  by 
interoperability  and  data  commonality, 
organizational  training 
simulations  may  now 
provide  a  significant 
and  credible  resource 
useful  in  the  successful 
and  cost-effective  man¬ 
agement  of  a  materiel 
acquisition.  This  paper 
identifies  key  findings 
from  a  case  study  of  the 
use  of  an  organizational 
training  simulation  in  support  of  acquisition. 
A  brief  overview  of  the  possible  mutual  ben¬ 
eficial  relationship  between  organizational 
training  simulation  and  the  materiel  acquisi¬ 
tion  system  is  presented.  Examples  of  ex¬ 
plicit  strategies  of  employing  training  simu¬ 
lation  in  acquisition  and  tenets  to  accom¬ 
plish  these  benefits  are  proposed. 

PM  Combat  Identification  effectively  col¬ 
laborated  with  PM  CCTT  and  other 
organizations  to  create  benefit  for  both  pro¬ 
grams.  Essential  to  the  success  was  their  will¬ 
ingness  to  take  advantage  of  the  inherent 
attributes  of  the  systems  themselves.  They 
capitahzed  on  the  scale  capabihties  of  the 
CCTT  to  represent  a  large  force  of  live  sys¬ 
tems.  Using  one  composite  system  to  rep¬ 
resent  many  resulted  in  significant  cost 
savings.  Secondly,  they  reused  the  BCIS 
existing  simulator  code  in  CCTT.  This  ac¬ 
tion  saved  both  time  and  money. 
Accompanying  the  resulting  cost  savings 


^^The  acquisition 
manager  is  key 
to  achieving 
synergy  between 
training  simuia- 
tion  and  acquisi¬ 
tion  modeis.../^ 


and  feedback  to  BCIS  was  a  synergistic 
flow  of  insights,  deliberately  common 
databases,  algorithms,  software  rou¬ 
tines,  architectures,  processes,  etc.  to 
CCTT. 

Also  essential  to  the  success  of  this 
case  study  was  the  roadmap  of  simula¬ 
tion  integration  created  by  the  Integrated 
Product  Team.  Planning  is  necessary  not 
only  for  the  purpose  of  coordination,  but 
also  to  accommodate  lead  times  for 
simulation  integration.  In  particular,  this 
case  study  indicates  successful  planning 
includes:  creating  new  opportunities  by 
innovate  thinking  and  risk  taking;  cul¬ 
tivating  a  total  life  cycle  perspective  so 
as  to  maximize  the  potential  to  create 
benefit  throughout  the  life  cycle; 
emphasizing  collaboration  within  Inte¬ 
grated  Concept  Team  and  Integrated 
Product  Team,  and  capitalizing  on  ex¬ 
isting  models  and  simulation  systems 
within  these  communities,  to  include  the 
training  community. 

Simulation  of  a  large-scale  field  exer¬ 
cise  was  made  possible  through  training 
simulation  strengths  in  interoperability 
and  data  commonality.  The  acquisition 
manager  is  key  to  achieving  synergy 
between  training  simulation  and  acquisi¬ 
tion  models  by  addressing  the  need  for 
increasing  model  fidelity  over  time  as  it 
relates  to  the  materiel  development. 
Organizational  training  simulations  may 
not  have  the  priority  or  perspective  that 
materiel  acquisition  managers  have  to 
develop  high  fidelity  models  of  new 
materiel.  Thus,  the  responsibility  rests 
with  materiel  acquisition  managers  to 
develop  models  of  sufficient  fidelity  for 
analysis.  Existing  process  mechanisms 
that  currently  speed  the  transfer  of  model 
data  from  materiel  acquisition  systems 
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into  the  training  simulations  may  also 
help  speed  acquisition  model  data  into 
training  simulations  for  operational  test¬ 
ing  purposes. 

Given  the  numerous  other  simulation 
systems  identified  by  the  earlier 
references,  the  use  of  organizational 
training  simulation  is  only  one  set  of 


tools  in  the  acquisition  community  ar¬ 
senal.  The  CCTT  is  one  of  those  tools. 
Raising  the  awareness  of  the  capabili¬ 
ties  of  the  training  simulation  commu¬ 
nity  to  the  acquisition  community  is  im¬ 
portant  for  the  war  fighter,  who  will  reap 
the  benefit  from  these  successes. 
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